Remote learning developments in postgraduate medical education in response to the COVID-19 pandemic - A BEME systematic review: BEME Guide No. 71.

BACKGROUND: Prior reviews investigated medical education developments in response to COVID-19, identifying the pivot to remote learning as a key area for future investigation. This review synthesized online learning developments aimed at replacing previously face-to-face 'classroom' activities for postgraduate learners. METHODS: Four online databases (CINAHL, Embase, PsychINFO, and PubMed) and MedEdPublish were searched through 21 December 2020. Two authors independently screened titles, abstracts and full texts, performed data extraction, and assessed risk of bias. The PICRAT technology integration framework was applied to examine how teachers integrated and learners engaged with technology. A descriptive synthesis and outcomes were reported. A thematic analysis explored limitations and lessons learned. RESULTS: Fifty-one publications were included. Fifteen collaborations were featured, including international partnerships and national networks of program directors. Thirty-nine developments described pivots of existing educational offerings online and twelve described new developments. Most interventions included synchronous activities (n Fif5). Virtual engagement was promoted through chat, virtual whiteboards, polling, and breakouts. Teacher's use of technology largely replaced traditional practice. Student engagement was largely interactive. Underpinning theories were uncommon. Quality assessments revealed moderate to high risk of bias in study reporting and methodology. Forty-five developments assessed reaction; twenty-five attitudes, knowledge or skills; and two behavior. Outcomes were markedly positive. Eighteen publications reported social media or other outcomes, including reach, engagement, and participation. Limitations included loss of social interactions, lack of hands-on experiences, challenges with technology and issues with study design. Lessons learned highlighted the flexibility of online learning, as well as practical advice to optimize the online environment. CONCLUSIONS: This review offers guidance to educators attempting to optimize learning in a post-pandemic world. Future developments would benefit from leveraging collaborations, considering technology integration frameworks, underpinning developments with theory, exploring additional outcomes, and designing and reporting developments in a manner that supports replication.

Online learning developments in undergraduate medical education in response to the COVID-19 pandemic: A BEME systematic review: BEME Guide No. 69.

BACKGROUND: The COVID-19 pandemic spurred an abrupt transition away from in-person educational activities. This systematic review investigated the pivot to online learning for nonclinical undergraduate medical education (UGME) activities and explored descriptions of educational offerings deployed, their impact, and lessons learned. METHODS: The authors systematically searched four online databases and conducted a manual electronic search of MedEdPublish up to December 21, 2020. Two authors independently screened titles, abstracts and full texts, performed data extraction and assessed risk of bias. A third author resolved discrepancies. Findings were reported in accordance with the STORIES (STructured apprOach to the Reporting in healthcare education of Evidence Synthesis) statement and BEME guidance. RESULTS: Fifty-six articles were included. The majority (n = 41) described the rapid transition of existing offerings to online formats, whereas fewer (n = 15) described novel activities. The majority (n = 27) included a combination of synchronous and asynchronous components. Didactics (n = 40) and small groups (n = 26) were the most common instructional methods. Teachers largely integrated technology to replace and amplify rather than transform learning, though learner engagement was often interactive. Thematic analysis revealed unique challenges of online learning, as well as exemplary practices. The quality of study designs and reporting was modest, with underpinning theory at highest risk of bias. Virtually all studies (n = 54) assessed reaction/satisfaction, fewer than half (n = 23) assessed changes in attitudes, knowledge or skills, and none assessed behavioral, organizational or patient outcomes. CONCLUSIONS: UGME educators successfully transitioned face-to-face instructional methods online and implemented novel solutions during the COVID-19 pandemic. Although technology's potential to transform teaching is not yet fully realized, the use of synchronous and asynchronous formats encouraged virtual engagement, while offering flexible, self-directed learning. As we transition from emergency remote learning to a post-pandemic world, educators must underpin new developments with theory, report additional outcomes and provide details that support replication.

Pivot to online learning for adapting or continuing workplace-based clinical learning in medical education following the COVID-19 pandemic: A BEME systematic review: BEME Guide No. 70.

BACKGROUND: The novel coronavirus disease was declared a pandemic in March 2020, which necessitated adaptations to medical education. This systematic review synthesises published reports of medical educational developments and innovations that pivot to online learning from workplace-based clinical learning in response to the pandemic. The objectives were to synthesise what adaptations/innovation were implemented (description), their impact (justification), and 'how' and 'why' these were selected (explanation and rationale). METHODS: The authors systematically searched four online databases up to December 21, 2020. Two authors independently screened titles, abstracts and full-texts, performed data extraction, and assessed the risk of bias. Our findings are reported in alignment with the STORIES (STructured apprOach to the Reporting in healthcare education of Evidence Synthesis) statement and BEME guidance. RESULTS: Fifty-five articles were included. Most were from North America (n = 40), and nearly 70% focused on undergraduate medical education (UGME). Key developments were rapid shifts from workplace-based learning to virtual spaces, including online electives, telesimulation, telehealth, radiology, and pathology image repositories, live-streaming or pre-recorded videos of surgical procedures, stepping up of medical students to support clinical services, remote adaptations for clinical visits, multidisciplinary team meetings and ward rounds. Challenges included lack of personal interactions, lack of standardised telemedicine curricula and need for faculty time, technical resources, and devices. Assessment of risk of bias revealed poor reporting of underpinning theory, resources, setting, educational methods, and content. CONCLUSIONS: This review highlights the response of medical educators in deploying adaptations and innovations. Whilst few are new, the complexity, concomitant use of multiple methods and the specific pragmatic choices of educators offers useful insight to clinical teachers who wish to deploy such methods within their own practice. Future works that offer more specific details to allow replication and understanding of conceptual underpinnings are likely to justify an update to this review.

Rapid Dissemination of a COVID-19 Airway Management Simulation Using a Train-the-Trainers Curriculum.

PROBLEM: The most effective way to train clinicians to safely don and doff personal protective equipment (PPE) and perform aerosol-generating procedures (AGPs), such as intubations, is unknown when clinician educators are unavailable, as they have been during the COVID-19 pandemic. Proper PPE and airway management techniques are critical to prevent the transmission of respiratory illnesses such as COVID-19. APPROACH: In March 2020, the authors implemented a structured train-the-trainers curriculum to teach PPE techniques and a modified airway management algorithm for suspected COVID-19 patients. A single emergency medicine physician trainer taught 17 subsequent emergency medicine and critical care physician trainers the proper PPE and airway management techniques. The initial trainer and 7 of the subsequent trainers then instructed 99 other emergency medicine resident and attending physicians using in situ simulation. Trainers and learners completed retrospective pre-post surveys to assess their comfort teaching the material and performing the techniques, respectively. OUTCOMES: The surveys demonstrated a significant increase in the trainers' comfort in teaching simulation-based education, from 4.00 to 4.53 on a 5-point Likert scale (P < .005), and in teaching the airway management techniques through simulation, from 2.47 to 4.47 (P < .001). There was no difference in the change in comfort level between those learners who were taught by the initial trainer and those who were taught by the subsequent trainers. These results suggest that the subsequent trainers were as effective in teaching the simulation material as the initial trainer. NEXT STEPS: Work is ongoing to investigate clinician- and patient-specific outcomes, including PPE adherence, appropriate AGP performance, complication rate, and learners' skill retention. Future work will focus on implementing similar train-the-trainers strategies for other health professions, specialties, and high-risk or rare procedures.

An update on developments in medical education in response to the COVID-19 pandemic: A BEME scoping review: BEME Guide No. 64.

BACKGROUND: COVID-19 has fundamentally altered how education is delivered. Gordon et al. previously conducted a review of medical education developments in response to COVID-19; however, the field has rapidly evolved in the ensuing months. This scoping review aims to map the extent, range and nature of subsequent developments, summarizing the expanding evidence base and identifying areas for future research. METHODS: The authors followed the five stages of a scoping review outlined by Arskey and O'Malley. Four online databases and MedEdPublish were searched. Two authors independently screened titles, abstracts and full texts. Included articles described developments in medical education deployed in response to COVID-19 and reported outcomes. Data extraction was completed by two authors and synthesized into a variety of maps and charts. RESULTS: One hundred twenty-seven articles were included: 104 were from North America, Asia and Europe; 51 were undergraduate, 41 graduate, 22 continuing medical education, and 13 mixed; 35 were implemented by universities, 75 by academic hospitals, and 17 by organizations or collaborations. The focus of developments included pivoting to online learning (n = 58), simulation (n = 24), assessment (n = 11), well-being (n = 8), telehealth (n = 5), clinical service reconfigurations (n = 4), interviews (n = 4), service provision (n = 2), faculty development (n = 2) and other (n = 9). The most common Kirkpatrick outcome reported was Level 1, however, a number of studies reported 2a or 2b. A few described Levels 3, 4a, 4b or other outcomes (e.g. quality improvement). CONCLUSIONS: This scoping review mapped the available literature on developments in medical education in response to COVID-19, summarizing developments and outcomes to serve as a guide for future work. The review highlighted areas of relative strength, as well as several gaps. Numerous articles have been written about remote learning and simulation and these areas are ripe for full systematic reviews. Telehealth, interviews and faculty development were lacking and need urgent attention.

In-situ Simulation Use for Rapid Implementation and Process Improvement of COVID-19 Airway Management.

INTRODUCTION: The coronavirus disease 2019 (COVID-19) pandemic presents unique challenges to frontline healthcare workers. In order to safely care for patients new processes, such as a plan for the airway management of a patient with COVID-19, must be implemented and disseminated in a rapid fashion. The use of in-situ simulation has been used to assist in latent problem identification as part of a Plan-Do-Study-Act cycle. Additionally, simulation is an effective means for training teams to perform high-risk procedures before engaging in the actual procedure. This educational advance seeks to use and study in-situ simulation as a means to rapidly implement a process for airway management in patients with COVID-19. METHODS: Using an airway algorithm developed by the authors, we designed an in-situ simulation scenario to train physicians, nurses, and respiratory therapists in best practices for airway management of patients with COVID-19. Physician participants were surveyed using a five-point Likert scale with regard to their comfort level with various aspects of the airway algorithm both before and after the simulation in a retrospective fashion. Additionally, we obtained feedback from all participants and used it to refine the airway algorithm. RESULTS: Over a two-week period, 93 physicians participated in the simulation. We received 81 responses to the survey (87%), which showed that the average level of comfort with personal protective equipment procedures increased significantly from 2.94 (95% confidence interval, 2.71-3.17) to 4.36 (4.24-4.48), a difference of 1.42 (1.20-1.63, p < 0.001). There was a significant increase in average comfort level in understanding the physician role with scores increasing from 3.51 (3.26-3.77) to 4.55 (2.71-3.17), a difference of 1.04 (0.82-1.25, p < 0.001). There was also increased comfort in performing procedural tasks such as intubation, from 3.08 (2.80-3.35) to 4.38 (4.23-4.52) after the simulation, a difference of 1.30 points (1.06-1.54, p < 0.001). Feedback from the participants also led to refinement of the airway algorithm. CONCLUSION: We successfully implemented a new airway management guideline for patients with suspected COVID-19. In-situ simulation is an essential tool for both dissemination and onboarding, as well as process improvement, in the context of an epidemic or pandemic.